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METHOD AND APPARATUS FOR STORING CONTENT WITHIN A 
VIDEO ON DEMAND ENVIRONMENT 

CROSS REFERENCE 
5 This application claims benefit of United States Provisional Application No. 
60/170,138, filed December 10, 1999, which is hereby incorporated by 
reference in its entirety. 

BACKGROUND OF THE INVENTION 

10 1. Field of the Invention 

The present invention relates to an information distribution system 
such as a video-on-demand (VOD) system. More particularly, the present 
invention relates to a method and apparatus for efficiently utilizing "on line" 
15 and "near line" storage media to provide increased availability of content 
streams to users. 

2. Description of the Background Art 

20 VOD systems providing content encoded according to the various 

Moving Pictures Experts Group (MPEG) standards are known. For 
example, a first standard known as MPEG-1 refers to ISO/IEC standards 
11172, which is incorporated herein by reference in its entirety. A second 
standard known as MPEG-2 refers to ISO/IEC standards 13818, which is 

25 incorporated herein by reference in its entirety. Additionally, a compressed 
digital video system is described in the Advanced Television Systems 
Committee (ATSC) digital television standard document A/53, incorporated 
herein by reference. 

The most important characteristic of a video on demand system is the 

30 experience of a user receiving content via that system. That is, a user 

ideally selects desired content and the system provides the desired content 
to the user in a timely manner and at a quality level consistent with the 
user's expectations. Failure to meet the user expectations in terms of image 
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quality, sound quality, system latency or other factors results in a less than 
satisfying experience to the user. 

In the case of a video on demand system utilizing a plurality of 
servers to provide content to users, it is seen to be desirable to sense 
5 anomalous conditions or other errors within a server presently providing 
content to a user and, upon determination that an error exists, migrating 
that user to a server not affected by the error condition. More specifically, it 
is seen to be desirable to provide a method and apparatus for migrating 
users between information server modules in a manner minimizing 
10 disruption of content streams being provided to the user. 

SUMMARY OF THE INVENTION 
The disadvantages heretofore associated with the prior art are 
overcome by the present invention of a method and apparatus for 
15 maximizing the number of content titles available within a video on demand 
system by storing an initial portion of each title on the primary storage 
device and a remaining portion of each title on a secondary storage device, 
wherein said secondary storage device is used to provision said primary 
storage device upon request of said content stream stored on said primary 
20 storage device. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The teachings of the present invention can be readily understood by 
considering the following detailed description in conjunction with the 
25 accompanying drawings, in which: 

FIG. 1 depicts a high level block diagram of an interactive 
information distribution system; 

FIG. 2 depicts a block diagram of an information server suitable for 
use in the interactive information distribution system of FIG. 1; 
30 FIG. 3 depicts a graphical diagram useful in understanding the 

present invention; 

FIG. 4 depicts a graphical diagram useful in understanding the 
present invention; and 
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FIG. 5 depicts a flow diagram of a method according to the present 
invention and suitable for use in the interactive information distribution 
system of FIG. 1 

To facilitate understanding, identical reference numerals have been 
5 used, where possible, to designate identical elements that are common to the 
figures. 

DETAILED DESCRIPTION 
FIG. 1 depicts a high level block diagram of an interactive 

10 information distribution system. Specifically, FIG. 1 depicts a high level 
block diagram of an interactive information distribution system 100 
containing the present invention. The system 100 contains service provider 
equipment 102, a communications network 104 and subscriber equipment 
106 n7 where n is an integer greater than zero. 

15 The service provider equipment 102 comprises an information server 

125, a session controller 145, a transport processor 150 and, optionally, a 
remote storage module 128. Briefly, the session controller 145, in response 
to a request(s) from subscriber equipment 106, causes the requested content 
to be retrieved from the information server 125 and provided to the 

20 transport processor 150. The transport processor 150 combines or 

multiplexes the retrieved content to provide an output data stream for the 
requesting subscriber(s). The output data stream is conditioned for 
transport to the requested subscriber via a forward application transport 
channel (FATC) within the distribution network 104. 

25 The information server 125 is used to store at least a portion of 

content such as movies, television programs and other information offerings 
of the interactive information distribution system 100 of FIG. 1. 
Additionally, the information server 125 is used to store assets such as bit 
map imagery, graphic overlay, control scripts and the like. The assets may 

30 comprise, for example, navigation assets that are used by a set top terminal 
to interactively navigate, and select for viewing, the offerings or content 
available from the service provider equipment 102. The information server 
125, in response to a control SC produced by the session controller 145, 
provides content and/or asset data to the transport processor 150. In the 
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case of the information server 125 storing only a portion of content 
requested by a user, the information server 125 communicates with a 
secondary storage module, such as remote storage module 128, to retrieve at 
least the remaining portion of the requested content. In this manner, the 

5 information server 125 may be used to store only a portion of each of a 

plurality of content streams (such as movies) available to users. This aspect 
of the system 100 of FIG. 1 will be described in more detail below with 
respect to FIGS. 2-5. The information server will be described in more 
detail below with respect to FIG. 2. 

10 The session controller 145 provides session control of the information 

flowing to and from the information server 125, and may be generally 
described as a system providing or controlling communications between, for 
example, a cable system head-end and one or more set top terminals 136 
The session controller 145 produces the storage control signal SC for 

15 controlling and communicating with the information server 125, and a 

transport processor control signal TPC for controlling and communicating 
with the transport processor 150. In response to a user request for 
particular content, the session controller 145 causes the requested content 
file and to be streamed from the information server 125 to the transport 

20 processor 150. The session controller 145 optionally produces a remote 
storage control signal RSC for controlling and communicating with the 
remote storage module 128. Remote storage control signal RSC is used to 
cause remote storage module 128 to begin the process of retrieving a 
remaining portion of a content stream requested by a user, where an initial 

25 portion of that content stream is stored within a primary storage device in 
the information server 125. In this manner, the provisioning of the primary 
server with the requested content may be more rapidly accomplished. 

The session controller 145 sends data, such as commands, encryption 
keys and the like, to set top terminals via a forward data channel (FDC). 

30 The session controller 145 receives data, such as information stream 

requests and session initiation data (set top identification, capability and 
the like) via a reverse data channel (RDC). The FDC and RDC are 
supported by the distribution network 104 and comprise relatively low 
bandwidth data channels, such as one-two megabits per second data 
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channels utilizing QPSK, QAM, or other modulation techniques. The FDC 
and RDC are also known as "out-of-band" channels, while the relatively high 
bandwidth forward application transport channel (FATC) is also known as 
an "in-band" channel. The session controller 145 contains an interface 
5 device for sending control information via the forward data channel FDC 
and receiving control information and request information via the reverse 
data channel RDC using the so-called "out-of-band" carrier frequencies. 

The transport processor 150 accomplishes all of the forward content 
channel transmission interface requirements of the system 100 of FIG. 1. 

10 Specifically, the transport processor 150 is coupled to subscriber equipment 
via the forward applications transport channel (FATC). That is, the 
transport processor 150 is capable of providing a plurality of scrambled or 
unscrambled content and/or asset streams modulated onto various carrier 
frequencies suitable for use in the distribution network 104. The FATC is 

15 supported by the distribution network 104 and comprises a relatively high 
bandwidth communications channel well suited to carrying video, audio and 
data such as, for example, multiplexed MPEG-2 transport packets. It 
should be noted that data normally conveyed to a set top terminal via the 
FDC may be included in the FATC data stream. The transport processor 

20 150 also contains a modulator for modulating the combined content and 
asset stream onto one or more carrier frequencies for transmission on the 
FATC, the so-called "in-band" carrier frequencies. 

The distribution network 104 can be any one of a number of 
conventional broadband communications networks that are available such 

25 as a fiber optic network, a telephone network, a cable television network and 
the like. For example, if the network is a hybrid fiber-coax network, the 
transmission transport technique used in both forward channels may be 
modeled after the Moving Pictures Expert Group (MPEG) transport protocol 
for the transmission of video data streams. In general, the transport 

30 mechanism for both of the forward channels that transport information to 
the set top terminal must be able to carry unidirectional, asynchronous 
packetized data such as that defined in the MPEG video and audio signal 
transmission protocol, and the like. There are a number of such transport 
protocols available. 
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The subscriber equipment 106 comprises a set top terminal or a set 
top box 136, a display device 140 (e.g. a conventional television) and a user 
input device 138 (e.g. a remote control device). Each set top terminal 136 
receives the data streams from the FATC, demodulates the received data 
5 streams and, in the case of video streams, processes the demodulated video 
streams for subsequent display on the display device 140. In the case of 
receiving scrambled data streams, the STT descrambles the received data 
streams using the descrambling messages DM provided to the STT via the 
FATC or the FDC. The STT uses the authorization messages AM provided 

10 via the FATC or FDC to determine if a descrambling of the received 
scrambled stream is authorized. In addition, the set top terminal 136 
accepts commands from the remote control input device 138 or other input 
device. These commands are formatted, modulated, and transmitted 
through the distribution network 104 to the session controller 145. 

15 Typically, this transmission is accomplished through the reverse data 
channel RDC. These commands are preferably transmitted through the 
same network used to transmit information to the set top terminal. 
However, the RDC coupling the set top terminal to the provider equipment 
102 may be a separate network, e.g. a FATC through a television cable 

20 network and an RDC through a telephone network. The telephone network 
could also support the FDC. 

FIG. 2 depicts a block diagram of an information server suitable for 
use in the interactive information distribution system 100 of FIG. 1. 
Specifically, the information server 125 of FIG. 2 comprises a plurality of 

25 server modules 220i - 220 m , where m is an integer (collectively service 

modules 220). Each of the server modules 220 is coupled to a respective disk 
array 110 functioning as a primary storage module. Each of the respective 
disk arrays 110 comprises, illustratively, a plurality of disks, such as optical 
or magnetic storage disks capable of providing an appropriately high 

30 throughput. It will be noted in FIG. 2 that the first disk array 110 1? which is 
coupled to the first server module (220 x ) comprises a plurality of disks 
denoted as DISK X through DISK,, where i is an integer. Similarly, disk 
array 110 3 , which is coupled to server module 220 3 comprises a plurality of 
disks denoted as DISK X through DISK*. To simplify FIG. 2, disks forming 
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the disk arrays 110 2 , 110 4 and 110 m of the remaining server modules 2 and 4 
through m are not shown. 

It will be appreciated by those skilled in the art that each server 
module 220 may be associated with more than one disk arrays 110. 

5 Moreover, the disk arrays 110 coupled to the server modules 220 may 

comprise high speed disk arrays suitable for providing primary or "on line" 
storage and/or lower speed disk arrays suitable for providing secondary or 
"near line" storage. In this context, primary storage media is defined as 
storage media capable of streaming (i.e., accessing and providing data to the 

10 buffer during the appropriate extent deadline) content in real time to a user 
within the system. By contrast, secondary storage is defined as media that 
typically does not stream real time content to users. Secondary storage 
comprises, illustratively, magneto optical disk drives, tape drives, and other 
media which provide relatively low cost storage of content and/or asset data, 

15 though typically at the expense of increased latency. It will be appreciated 
that while secondary storage is typically defined as non-realtime capable, 
that consideration is strictly a matter of system architecture selection. 
Since the cost of mass storage devices is decreasing dramatically while the 
capability of such devices is increasing dramatically, present mass storage 

20 technology is capable of providing inexpensive, realtime content streaming 
functionality. 

Storage devices may be segmented into a plurality of groups; namely, 
on line, offline, and near line. On line storage units, such as primary 
storage units comprising disk drive arrays and other high speed storage 

25 units are suitable for providing streamed content directly to users. Offline 
storage devices are most suitable for archival purposes (e.g., tape drives and 
other sequential access devices). Near line storage devices, such as 
magneto-optical disks and other relatively slow mass storage devices, are 
capable of provisioning on line devices in a sufficiently rapid manner (i.e., 

30 provisioning a primary device in a timely manner such that a content 
stream provided to a user is maintained). 

For purposes of simplification, it is assumed that the disk arrays 110 
of FIG. 2 are primary storage media. Within the system 100 of FIG. 1, such 
primary storage media typically store at least an initial portion of a core 
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group of the content and/or asset data available from the information 
provider equipment 102. However, in the case of a user requiring non- 
primary content, such as an old movie or some other content and/or asset 
data deemed ill suited for primary storage, the server module 220 
5 supporting that particular user will have to move the desired content from 
the appropriate secondary storage module (e.g., a tape drive) to the primary 
storage module (e.g., a disk array). As will be discussed in detail below, the 
present invention enables the storage of initial portions of a very large 
subset (or all) of the available content on primary storage media. 
10 As noted in FIG. 2, a local secondary storage module 115 is associated 

with the first server module 220^ It will be appreciated by those skilled in 
the art that the local secondary storage module 115 may be associated with 
each of the server modules 220 within the information server 125 of FIG. 2. 
Moreover, each of the server modules 220 may be associated with a plurality 
15 of secondary storage modules (not shown) such that the server modules 220 
are respectively associated with "shared" and "non-shared" local secondary 
storage modules. 

In one embodiment of the invention, one or more of the server 
modules 220 of the information server 125 are operably coupled to the 
20 remote storage module 128 depicted in FIG. 1. The remote storage module 
128 may comprise any high capacity storage module suitable for storing 
either the remainder portion of content streams or entire content streams. 
Additionally, remote storage module 128 (as with the local secondary 
storage modules 115) is used to store the play stream, fast forward stream, 
25 rewind stream, associated audio streams, and any other streams related to 
the content. Alternatively, a remote secondary storage module 115R is 
depicted as cooperating with the server modules 220 (illustratively, server 
module 220J to provide secondary storage functionality. 

It is noted that the remote secondary storage module 115R and/or the 
30 remote storage module 128 may be coupled to the server modules 220 via a 
high speed network such as an optical network, the internet, a satellite 
network and the like. All that is required is that the appropriate content 
stream or content stream portion to be served to a user is accessible in a 
timely manner and that the network communicating the content or content 
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portion from the remote secondary storage 115R or remote storage module 
128R includes sufficient bandwidth. It is also noted that the secondary 
storage devices 115, 115R and the remote storage module 128 may store 
portions or entireties of content streams. 

In one embodiment of the invention, a primary storage device 
includes only an initial portion of a content stream to be provided to a user. 
In response to the user selecting the content stream, a secondary storage 
device is immediately utilized to provision the primary storage device with 
the remaining portion of the content stream. Thus, the primary storage 
device is used to store the entirety of a content stream requested by a user, 
and such provisioning of the primary storage device is effected upon, for 
example, a user request for the content stream. 

In alternate embodiments of the invention, the secondary storage 
device streams the remaining portion of content to the requesting user 
while, optionally, provisioning the primary storage device with the 
remaining portion of the content stream. In this manner, multiple users 
requesting the same content stream may be satisfied via a single access of 
the secondary storage device. 

In the case where the primary storage device is provisioned by the 
secondary storage device, the primary storage device may be used to stream 
the remaining portion of content after such provisioning. In this example, 
the initial portion of a content stream requested by a user is provided by a 
primary storage device, a first portion of the remaining portion is then 
provided by the secondary storage device which also contemporaneously 
provisions the primary storage device with the remaining portion of the 
content stream. Upon completion of the provisioning of the primary storage 
device, the primary storage device is again used to provide the content 
stream directly to the user. Thus, transitions in servicing the user are made 
from the primary storage device to the secondary storage device at the end 
of the stored initial portion of the content, and from the secondary storage 
device to the primary storage device after provisioning of the primary 
storage device. Such transition may be effected by migrating users between 
primary and secondary storage device s/servers. 
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An information server 125 suitable for use in the present invention is 
described by Chin et al. in U.S. Patent No. 5,579,527 and incorporated 
herein by reference in its entirety. A system for supplying streams to 
multiple users suitable for use in the present invention is described by 

5 Bleidt et al. in U.S. Patent No. 5,671,377 and incorporated herein by 
reference in its entirety. It must be noted that while the invention may 
advantageously utilize a massively parallel storage, retrieval and 
distribution system, the invention does not require the use of such a system. 
Rather, the invention is well suited to any storage arrangement in which the 

10 user is receiving data from a plurality of server modules storing similar data 
are migrated between the server modules. 

A method and apparatus for minimizing disk drive access time in, 
e.g., a disk drive array and suitable for use in the present invention is 
described by Armstrong in commonly assigned U.S. Patent Application No. 

15 08/818,172 (Attorney Docket No. 533/11635), filed on March 14, 1997 and 
incorporated herein by reference in its entirety. 

Each server module 220 (within the information server 125) is 
associated with a respective buffer 225. Each buffer memory is capable of 
holding at least one service period (i.e., one extent) worth of information 

20 retrieved from a disk array 110 via the respective server module 220. Each 
buffer 225 is coupled to a switch 230. 

The switch 230 operates to multiplex the contents of each buffer 225 
in a round robin fashion to produce an output stream OUT that is coupled to 
the transport processor 150 for subsequent transport to the appropriate 

25 subscribers 106 via the forward application transport channel (FATC) 
supported by the distribution network 140. The exemplary embodiment 
uses a service period of two seconds. Thus, each extent retrieved from a 
single disk within a disk array 210 comprises two seconds worth of 
information, illustratively, video information and associated audio 

30 information. Thus, in the case of 30 frames per second video, each buffer 
225 must hold at least 60 frames of video and any associated audio 
information. The output stream OUT is modulated by modulation circuitry 
within the transport processor 150 and transmitted to the appropriate 
subscribers. 
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In one embodiment of the invention, each of the output buffers 225 
supporting the server modules 220 comprise respective portions of a 
common memory module. That is, each of the server modules 220 stores 
data to a respective portion of a common memory module. In this 
5 embodiment of the invention, the switch 230 utilizes a direct memory access 
(DMA) output link table 235 to access the appropriate portions of the 
common buffer memory to retrieve the contents of each of the output buffers 
225. 

Each server module 220 is capable of providing information to a 

10 plurality of users 106. Thus, each buffer 225 associated with a server 

module 220 is capable of holding at least one extent of data for each of the 
plurality of subscribers 106 serviced by that server module 220. For 
example, if the first server module (220 x ) is capable of serving 100 
subscribers, then the buffer 225 x associated with the first server module 

15 220 x must be capable of holding at least 200 seconds worth of information, 
illustratively video information and any associated audio information. 

Under normal operating circumstances, each server module 220 
retrieves information from its respective disk array (primary storage) for 
each subscriber 106 supported, and transfers the retrieved information to 

20 the respective buffer (or buffer region) 225. The switch 230 accesses each 
buffer 225 in a round robin fashion to produce an output stream OUT 
comprising the multiplexed contents of each of the buffers 225 x to 225 m . In 
the case of only a portion of each available information stream being stored 
in a respective disk array, the stored portion is transferred to the respective 

25 buffer 220 while at the same time the remaining portion is retrieved from a 
secondary storage unit, such as local secondary storage module 115 or 
remote secondary storage module 128. 

In the case of a server module failure, a primary or secondary storage 
failure such as a disk array failure, a buffer failure, or some other event 

30 affecting the flow of information to subscribers via one of the server modules 
220, the users on the affected server module 220 is migrated to another 
server module. Since the information server 125 comprises a plurality of 
server modules 220, the loss of one or more server modules 220 may be 
compensated for by migrating some or all of the users from the damaged 
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server module(s) to the remaining, functional server modules. In this 
manner, component failures within the information server 125 will result in 
a degradation of information server performance that, ideally, will not 
adversely impact the experience of users receiving content streams within 
5 the information distribution system 100 of FIG. 1. 

Advantageously, a user may also be migrated to another server 
module if the other server module includes, in a respective primary storage 
module, the entire content stream requested by that user. Specifically, 
assume that a first server module is servicing a user that has requested a 

10 particular content stream. If the particular content stream is only partially 
stored in the primary storage associated with the first server module, then 
the remaining portion of the requested content must be retrieved from a 
secondary storage module. However, if another server module includes the 
entirety of the requested content within its primary storage, then the user 

15 may be migrated to the second server module. In this manner, the user 
content request may be satisfied without resorting to secondary storage 
access. Apparatus and method for effecting a user migration between server 
modules is described in more detail in commonly assigned U.S. Patent 
Application Serial No. , filed on , (Attorney 

20 Docket No. 533/241), which is incorporated herein by reference in its 
entirety. 

To accomplish such migration of users between server modules 220, 
and to determine if requested content is available on other server modules 
220, the server modules 220 communicate with each other via a service 
25 module bus SMBUS to determine if such a migration is possible or useful. 

FIG. 3 depicts a graphical diagram useful in understanding the 
present invention. Specifically, FIG. 3 depicts a graphical representation of 
content stored by a primary storage module and a secondary storage module 
according to one aspect of the invention. Specifically, a primary storage 
30 module, such as the disk array 110, is used to store only a portion of each of 
a plurality of content streams. Each content stream comprises at least a 
play track and, optionally, a fast forward track and rewind track. A play 
track comprises a normal speed track. A fast forward track comprises a 
temporally decimated version of a play track which, when played by the 
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subscriber equipment 106, results in a fast forward or "special play" 
presentation of the content on the user's presentation device. A rewind 
track comprises a temporally decimated version of a play track which has 
been reversed in order (e.g., a frame-reversed FF track) such that, when 
played by a user, results in a rewind or "reverse play" presentation of the 
content. It should be noted that fast forward and rewind tracks may be 
created to impart any desired increase in apparent play rate. However, in 
keeping with the traditional fast forward/rewind rates of standard analog 
video cassette recorders (VCRs), the exemplary embodiment uses fast 
forward rewind tracks having a presentation rate of between seven and nine 
times the presentation rate of the play track. 

Referring to the primary storage 110 depicted in FIG. 3, a plurality of 
content streams Ml-MZ (310 r 310z) are depicted as being represented by 
respective initial play (P), fast forward (FF) and rewind (R) portions. Each 
of the respective initial portions of the content streams Ml-MZ (310 1 - 310 z ) 
is sufficient to provide an initial presentation of, for example, 20 minutes to 
a requesting user. Additionally, a portion 320 of primary storage is reserved 
for the remainder of content being streamed to a requesting user. 
Specifically, a reserved portion 320 of primary storage is used to store the 
remainder portion of content stream(s) requested by user(s) within the 
system. 

Referring to the secondary storage 115/128 depicted in FIG. 3, a 
plurality of at least remaining portions of the content streams Ml-MZ (330 r 
330 z ) are depicted as being stored therein. For example, in the case of a user 
requesting a first content stream Ml (3100, the play track of the first 
content stream M1P is streamed to the requesting user. The remaining 
portion of the first content stream Ml is retrieved from the secondary 
storage module such as local secondary storage module 115 or remote 
secondary storage module 128and stored in the reserved portion 320 of the 
primary storage module 110 for subsequent streaming to the requesting 
user. It is important to store at least some of the remaining portion of the 
requested content in reserved portion 320 prior to the presentation of the 
terminating image frame F Y1 . In this manner, the stream provided to the 
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user may be changed from the initial content stream 310 to a remaining 
content stream 320 in a relatively seamless manner. 

Referring to FIG. 3, a primary storage module (illustratively a disk 
array 110) is depicted as storing respective initial portions of each of a 

5 plurality of content streams (denoted as Ml through MZ while a secondary 
storage module (illustratively a magneto-optical or tape drive) is depicted as 
storing respective remaining portions of the plurality of content streams). 
While the following discussion is primarily directed to a first content stream 
Ml, it will be understood that the discussion is equally applicable to the 

10 other content streams M2-MZ. 

Specifically, a portion of a first content stream Ml is stored as a play 
track portion M1P, a fast forward track portion MIFF and a rewind track 
portion MIR. The play track portion M1P comprises all frames between a 
first image frame F 01 and a terminating image frame F Y1 . The first image 

15 frame F 01 comprises the first image frame of the content stream Ml. The 
terminating image frame F yi comprises the last image frame of the initial 
portion of the content stream MI stored in the primary storage device. For 
purposes of this discussion, it will be assumed that a 20 minute portion of 
each content stream Ml - MZ is stored in the primary storage device. 

20 Therefore, assuming a frame rate of 30 frames per second, the terminating 
image frame F Y1 is approximately the 36,000 th frame of the first content 
stream Ml. 

The fast forward track portion MIFF of the content stream Ml 
comprises that portion of the fast forward track including the first image 

25 frame F 01 and the terminating image frame F Y1 . Similarly, the portion of the 
rewind track MIR of the content stream Ml comprises that portion of the 
rewind track including the terminating image frame F Y1 and the first image 
frame F 01 . In the embodiment of the invention depicted in FIG. 3, the 
rewind track MIR of the content stream Ml comprises, essentially, a 

30 reversed frame order version of the fast forward track MIFF of the content 
stream Ml. However, as will be discussed in more detail below, the fast 
forward and rewind tracks do not need to be of the same length, nor must 
they be inclusive of the same content. However, to simply the discussion of 
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the present invention, the fast forward and rewind tracks are made 
symmetrical as shown in FIG. 3, 

Thus, an initial (e.g., 20 minutes) portion of a first content stream Ml 
is represented by those portions of a corresponding play track M1P, fast 
5 forward track MIFF and rewind track MIR bounded by an initial image 
frame F 01 and a terminating image frame F Y1 . Though not shown, it will be 
appreciated by those skilled in the art that at least the audio portion 
associated with the play track M1P is also stored in the primary storage 
device and presented with the play track. In addition to the audio portion, 
10 meta-data and other auxiliary data related to the content stream may also 
be stored on the primary storage device for utilization within the 
presentation of the content by a user. 

In one embodiment of the invention, the fast forward track MIFF and 
rewind track MIR associated with the content stream do not include all of 
15 the corresponding frames associated with the entire play track M1P. 
Specifically, since the major use for a fast forward track, at least at the 
beginning of a content stream, is fast forwarding through introductory 
materials, trailers, credits and other content other than the feature 
presentation of the content stream, such non-feature presentation content is 
20 included within the fast forward track MIFF. In this manner, the storage of 
fast forward (and, optionally, rewind) track information associated with 
feature presentation is avoided. 

Referring to FIG. 3, it is noted that the secondary storage module is 
depicted as including the entire play, fast forward, and rewind tracks for 
25 each of a plurality of content streams denoted as Ml-MZ (330 x -330 z ). 

Specifically, the entire play track M1P, fast forward track MIFF and rewind 
track MIR of the entire content stream Ml is depicted as being stored in a 
memory region 330 x of the secondary storage module. Similarly, the entire 
play track, fast forward track and rewind track of content streams 2-Z are 
30 depicted as being stored in respective regions 330 2 - 330. However, in 
another embodiment of the invention, only the remaining portion of the 
content stream is stored in the secondary storage module. That is, the 
primary storage module 110 is used to store only the initial portion, while 
the secondary storage module is used to store only he remaining. 
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FIG. 4 depicts a graphical diagram useful in understanding the 
present invention. Specifically, FIG. 4 depicts a graphical representation of 
the play track 410, fast forward track 420 and rewind track 430 of a content 
stream. 

5 A first or initial portion PT p of the play track is stored on a primary 

storage module, while at least a remaining portion PT S of the play track 410 
is stored on a secondary storage module. A first or initial portion FFT P of the 
fast forward track 420 is stored on the primary storage module, while a 
remaining portion FFT S of the fast forward track is stored on the secondary 

10 storage module. A first or initial portion RT P of the rewind track 430 is 
stored on a primary storage module, while a remaining portion RT S of the 
rewind track 430 is stored on a secondary storage module. 

It is assumed that the portion PT P of the play track 410 stored on the 
primary storage module comprises a 20 minute play track. Referring to 

15 FIG. 4, the portion PT P of the play track stored on the primary storage 

module begins at a time t 0 with an initial image frame F 0 and terminates at 
a time t Y with a terminating image frame F Y . Each of the fast forward track 
portion FFT P and rewind track portion RT P begin at time t 0 and terminate at 
a time t x . The fast forward track portion FFT P begins with an image frame 

20 F 0 and terminates with an image frame F Y . By contrast, the rewind track 
portion RT P begins with an image frame F Y and terminates at the image 
frame F 0 . 

The time t 0 is the time at the start of each track stored in the primary 
storage module. The time ty is equal to the time at which the play track 

25 portion PT P ends. The time is the time at which the fast forward track 

portion FFT P and rewind track portion RT P ends. The time is related to t Y 
by the fast forward/rewind rate of the fast forward track 420 and rewind 
track 430. For example, if the FF/REW rate is equal to approximately nine 
times the play rate, then ty is equal to approximately nine times t x . 

30 Therefore, if ty is determined to be 20 minutes, then t x is equal to 
approximately 2.22 minutes. 

FIG. 5 depicts a flow diagram of a method according to the present 
invention and suitable for use in the system of FIG. 1. Specifically, FIG. 5 
depicts a flow diagram of a method 500 for satisfying user requests for 
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content within the context of a system in which content is only partially 
stored in a primary storage module (as described above with respect to 
FIGS. 2, 3 and 4). 

The method 500 is entered at step 502 and proceeds to step 504, 
5 where a session with a user is established. That is, the server controller 145 
sets up the physical channel and logical channel for providing content in the 
user via the FATC. In addition, Navigation assets and other data are 
provided to the user. The method 500 then proceeds to step 506, where a 
user request for content is received, and to step 508. 

10 At step 508 the requested content is accessed from the primary 

storage module and is streamed to the requesting user. That is, at step 508 
the portion of the requested content stored in the primary storage module 
associated with the server module servicing the user is accessed and coupled 
to the transport processor 150. The transport processor 150 begins 

15 providing the content to the user via the forward applications transport 
channel (FATC) on the physical and local channel defined by the session 
controller 145 and communicated to the requesting user during session 
establishment at step 504. The method 500 then proceeds to step 510. 

At step 510 a query is made as to whether the requested content is 

20 stored entirely in primary storage. That is, a query is made as to whether 
the particular server module 220 providing content to the requesting user is 
associated with a primary storage module (such as disk array 110) that 
includes the requested content and any auxiliary streams (e.g., fast forward 
and rewind streams) in their entirety. If the query at step 510 is answered 

25 affirmatively, then the method proceeds to step 512 where it is exited. In 
this case, the content is retrieved from primary storage in the normal 
manner and provided to the requesting user. If the query at step 510 is 
answered negatively, then the method 500 proceeds to step 514. 

At step 514 the location of the remainder of the requested content is 

30 determined. That is, at step 514 it is determined whether the remaining 
portion of the content (play, fast forward, rewind, audio and other tracks) 
associated with the requested content is stored on a local secondary storage 
device 115 or the remote secondary storage device 128. The method 500 
then proceeds to 516. 
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At step 516 the remainder of the requested content is accessed from 
the secondary storage device determined in step 514. The method 500 then 
proceeds to step 518, where the server module 220 servicing the requesting 
user is provisioned with the remainder of the requested content and any 
5 auxiliary streams. That is, at step 518 the remaining portion of the 

requested content is stored in a primary storage device associated with the 
server module servicing the requesting user. 

It should be noted that, as previously discussed, a secondary storage 
device is (typically) unable to provide real time streaming of content to a 

10 user, while a primary storage device is capable of providing real time 

streaming of content to a user. Thus, it is likely that the newly provisioned 
content on the primary storage device will begin streaming to the requesting 
user prior to the conclusion of the provisioning process. 

Most important is that the user's experience is not significantly 

15 degraded or interrupted. Thus, as long as the secondary storage unit (115 or 
128) provisions the primary storage unit (display 110) at a sufficiently high 
rate such that the transport processor 150 is able to continuously provide 
play, fast forward, rewind and other tracks to the user, then the system is 
working effectively. The method 500 then proceeds to step 520. 

20 At step 520 the requesting user is transitioned to the newly 

provisioned remainder stream(s) as appropriate. That is, at step 520 a 
transition is made in the content stream supplied to the requesting user 
from the initial content stored on the primary storage device to the 
remaining content that has been provisioned onto the primary storage 

25 device. In the case of a second primary storage device including the 
requested content, the first primary storage device is not provisioned. 
Rather, the user stream is retrieved from the second primary storage device. 

With the above-described method 500, the user receives a requested 
content stream without any visual or aural artifacts, while the provider 102 

30 efficiently utilizes primary storage in a manner making a large number of 
titles available to each user. Such efficient storage utilization helps drive 
down system costs and improve system reliability. The method 500 then 
proceeds to step 522 where it is exited. 
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Optionally, after determining the location of the remainder of the 
content requested by the user at step 514, the above method 500 proceeds to 
step 530. At step 530 a determination is made (step 532) as to whether the 
remaining content is located on a primary storage module associated with 

5 another server module 220 within the information server 125. That is, at 
step 532 a determination is made as to whether another server module has 
associated with it a primary storage device including the content requested 
by the user. If the query at step 532 is answered negatively, then the 
method 500 proceeds to step 516. If the query at step 532 is answered 

10 affirmatively, then the method 500 proceeds to step 534. 

At step 534 the user is migrated from the present server module to 
the other server module. That is, since another server module includes, in a 
respective primary storage means, the content requested by the user, that 
requesting user is migrated over to the other circuit module. Apparatus and 

15 method for effecting this migration between server modules is described in 
more detail in commonly assigned U.S. Patent Application Serial No. 

, filed on __ which is 

incorporated herein by reference in its entirety. 

After migrating the requesting user from the present server module 

20 to the server module including the requested content stored in the 

respective primary storage means, the method 500 proceeds to step 536 
where it is exited. 

In the exemplary embodiments of the invention discussed above, the 
illustrative portion of the play track stored within the primary storage is 

25 approximately 20 minutes. The 20 minute storage amount is determined 
with respect to the speed of the secondary storage devices and the possible 
use of a fast forward by a user to quickly traverse the entire initial content 
portion. For example, in the interactive information distribution system 100 
of FIG. 1, a user requesting a content stream will begin to receive the 

30 content stream from the primary storage. If the user immediately depresses 
a "fast forward" key on an input device 138, then the set top terminal 
136associated with the user selects from the FATC, the fast forward stream 
corresponding to the presently received content stream. Thus, a user may 
rapidly traverse the entire portion of content stored in the primary storage. 
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In the case of a fast forward stream operating at nine times the frame rate 
of the play stream, a user will be able to traverse the entire 20 minutes of 
play track in only 2.22 minutes. Therefore, it is necessary that the 
remaining portion of the content be provided to the primary storage or, 
alternatively, the user be migrated to a server module including the 
requested content, prior to 2.22 minutes after beginning presentation of the 
requested content stream. While not the normal or likely user action, a user 
who has already seen most of the requested content may simply fast forward 
to that portion of the content which has not previously been viewed. Thus, 
it is important to insure that the provisioning of primary storage or 
migration of user be accomplished in a manner that "stays ahead" of the fast 
forward or play track demands put upon the system by the user. For 
example, in the case of a relatively slow secondary storage device, such as a 
sequentially accessed magnetic tape device in which content may be stored 
toward the middle or even end of a tape, it may be necessary to increase the 
size of the initial portion of the content stream stored on the primary 
storage device. Thus, the primary storage may be used to store anywhere 
from five minutes to 40 minutes of content, based upon the speed of 
secondary storage or other determination directed toward assuring a 
continued, uninterrupted stream of content to a requesting user. The 
amount of initial content storage is adapted to the system's storage 
capabilities (i.e., speed, access time, primary and secondary storage mix and 
the like) and to the acceptable acceptable probabilistic risk level of dropping 
a stream (i.e., allow only partial fast forward within the initial content and 
other limitations). 

The portion of content rewind track stored in the primary storage 
must also be adapted to the ability of the system. Specifically, in the case of 
a user fast forwarding through the initial portion of content stored in the 
primary storage, that user may decide to rewind at some point. It is 
necessary to provide a rewind stream in which the user may move from a 
fast forward (or play) track to the rewind track. Thus, it is desirable to 
include a rewind track including those frames within the fast forward track. 

It is noted that the play track, fast forward track and rewind tracks 
are all provided to the requesting user based upon user interaction. Each of 
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these tracks is indexed in a manner facilitating transitioning between tracks 
such that the fast forward, rewind and play paradigms known to users from 
the analog video cassette recorder (VCR) world are maintained. 

The above-described invention advantageously leverages the value of 

5 primary storage by using secondary storage to store portions of content 

likely to be not immediately required to satisfy user requests. Therefore, in 
a system in which thousands of titles, such as movies, are available, the 
above-described invention allows immediate user access to all of these titles. 
By contrast, previous systems stored entire content streams on a primary 

10 storage device such that only a small portion (e.g., 400 titles) of the available 
titles were immediately available. Users requesting content not within the 
primary storage had to wait until that content was retrieved from secondary 
storage and used to provision a primary storage device. Thus, the above- 
described invention reduces average latency experienced by users. 

15 Although various embodiments which incorporate the teachings of the 

present invention have been shown and described in detail herein, those 
skilled in the art can readily devise many other varied embodiments that 
still incorporate these teachings. 
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